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DETAILED ACTION 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
09/02/03 has been entered. 

Response to Amendment 

2. The amendment filed on 09/02/03 has been entered. Claims 1 , 6, 10, and 17 
were amended by this amendment. 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

4. Claims 1-7 and 9 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
which was not described in the specification in such a way as to reasonably convey to 
one skilled in the relevant art that the inventor(s), at the time the application was filed, 
had possession of the claimed invention. The amendment to claim 1 at lines 12-13 
added the following limitation that is not fully supported by the specification for each 
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portion of the image that is translucent, reading, blending and displaying the data from the 
one or more sources corresponding to the translucent portion. The reason this newly 
added limitation is not supported by the specification is because when one source, note 
the one or more sources limitation, is claimed the specification does not support this 
because the specification at page 6 lines 21-23 describes reading more than one 
source when a portion of the image is translucent. The examiner suggests deleting the 
limitation one or more such that the claim would read at lines 12-13 for each portion of 
the image that is translucent, reading, blending and displaying the data from the sources 
corresponding to the translucent portion. If this amendment were made then the 
preamble which claims at line 2 one or more sources would conflict with this part of 
claim 1. Amending the preamble to claim sources would require amending claim 1 at 
lines 6 and 14-15 to also claim sources rather than one or more sources. This change 
would render claim 6 to fail to further limit claim 1 since claim 6 claims two or more 
sources which is the same as sources. Similarly this change would cause the preamble 
of claim 7 to fail to further limit claim 1 since claim 7 claims two or more sources which 
is the same as sources. 

5. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

6. Claims 7, 15, 21-27 are rejected under 35 U.S.C. 112, second paragraph, as 
being indefinite for failing to particularly point out and distinctly claim the subject matter 
which applicant regards as the invention. 
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Claim 7 at line 2 "the two or more sources" lacks antecedent basis in the claims 
since this limitation was cancelled from claim 6. 

Claim 15 at line 3 "two or more of the data streams having a first color space" 
and at line 5 "two or more of the data streams having a second color space" lacks 
antecedent basis in the claim. 

Claim 21 claims at line 4 "a blending unit", at lines 6-7 "one or more blending 
units" and at line 10 "converting the outputs to a single color space", thus, this claim is 
confusing because the data streams are received at a blending unit then directed to one 
blending unit to produce an output which is blended, but, if there is only one blending 
unit then how can the data stream be received and directed to the same blending unit 
and how can there be outputs from different color spaces to be blended. At page 21 
lines 18-20 the specification describes each blending unit receiving each data stream, 
thus, lines 4 and 6-7 of claim 21 does not clearly claim the described invention when 
applicant claims directing the data stream to one blending unit. Applicant needs to 
carefully redraft this claim to clearly claim the invention. Claim 26 claims one or more 
blending units at numerous places and is indefinite for the same reasons given form 
claim 21. 

Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 
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8. Claims 1-6, 9-14 and 16 are rejected under 35 U.S.C. 102(b) as being 
anticipated by the newly cited article titled The Microsoft Interactive TV System: An 
Experience Report by Michael B. Jones, July, 1997, Technical Report MSR-TR-97-18. 
A very pertinent portion of this article is reproduced below. 

3. Set-Top Box Hardware 

The set-top box used in this trial was designed by Microsoft and manufactured by NEC. It uses a standard 
PC backplane, a 90 MHz Pentium processor (but clocked at 75 MHz), and a PCI bus. An NEC PCI ATM card is 
being used in the trial. Unlike a PC, the set-top box contains no disk, keyboard, mouse, or BIOS. 

Custom video and audio hardware for the set-top box contains a MPEG-2 decoder, NTSC (the U.S. and 
Japanese analog television encoding standard) encoders & decoders, a tuner, and an audio mixer. A custom graphics 
chip called the Burma is capable of dynamically scaling and alpha blending (semi-transparently overlaying) multiple 
video and computer-generated graphics surfaces using different pixel representations into a single, flicker-filtered 
output image in real time. (Flicker filtering reduces the flicker associated with NTSC's interlaced display and slow 
refresh rate.) 

The set-top box also has a bi-directional infrared port for communicating with the hand controller, a smart 
card interface, a serial port (used for debugging), a microphone input, auxiliary audio & video inputs, and separate 
audio and video outputs for TV and VCR. 

The processor has an 8Ki/8Kd on-chip cache. There is no second level cache. The system was designed for 
8MB of RAM, although it was typically used with 16MB and was eventually deployed with 24MB (more about this 
in section 12.4). The graphics system uses 2MB of RAMBUS memory, plus the MPEG-2 decoder contains 2MB of 
RAM. The system has 1/2 MB of boot ROM. 
3.1 Burma Graphics Chip 

The Burma graphics chip is central to Microsoft's interactive TV set-top box. In particular, it provides us 
with the capability of combining real-time video with dynamic computer-generated graphics under programmatic 
control. 

The primary job of the Burma is to dynamically composite sets of video and computer-generated images 
into an output image. Images are represented as lists of spans, where a span is a horizontal line of pixels. Since spans 
can be of different lengths and have different origins, Burma images need not be rectangular. 

Pixels can be represented in these data formats: 8-bit palletized color, 8-bit palletized color plus 8-bit alpha 
value, 16-bit Red-Green-Blue (RGB) (5R:6G:5B), 32-bit Lununance-Chrorninance (YCrCb) pixel pairs (8-bit Y 0 , 8- 
bit Yi, 8-bit shared Cr, 8-bit shared Cb), 24-bit RGB, and 24-bit RGB plus 8-bit alpha. Those formats without per- 
pixel alpha values have per-span alpha values. Flicker filtering can be controlled on a per-span basis. 

Major functional blocks within the Burma include two video capture engines, a color space converter, a 
static composition engine (a blitter) with source transparent color checking, a dynamic composition engine 
(performs alpha blending), a flicker filter, video output, a PCI interface with pre-fetcher and a RAMBUS interface. 

The Burma was designed to be clocked at 62.5MHz and is actually clocked at 50MHz. The 8-bit RAMBUS 
channel was designed to be clocked at 250MHz, and was actually clocked at 200MHz (4 x 50 MHz). RAMBUS 
transfers occur on both up and down transitions, giving an ultimate achievable speed of SOOMbytes/second or a BLT 
rate of 250Mbytes/second. In practice, about 50% of that is achievable with the Burma. 

The Burma chip is implemented as a custom ASIC fabricated using a .35 micron process. The chip size is 
8.68 x 8.68 mm. It contains 252K total gates, or roughly 1 million transistors. The logic is 140K gates, plus 56Kbits 
of RAM. 
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A detailed analysis of the claims. 
Claim 1: 

The article teaches in a system including a display device for displaying an image 
(interlaced television, section 3, and figures 2-1, 7-1, 7-2, 7-3), the image having one or 
more sources (sections 3 and 3. 1 and figures 2-1, 7-1, 7-2, 7-3), a method for 
compositing the image (sections 3 and 3.7 and figures 2-1, 7-1, 7-2, 7-3), the method 
comprising the acts of: 



whole image is one slice, assume two or more slices then the lists of spans for an 
image described in section 3.1 second paragraph is a slice), each slice including at 
least one line (section 3. 1 second paragraph describes each span as a horizontal line of 
pixels and each image has at least one line ofpixels)\ 



describe representing images as lists of spans, section 3. 1 second paragraph), wherein 
each span has at least one associated source (each span is for one of the images 
forming the TV image, thus, the span has at least one source) included in the one or 
more sources and each line in each slice has the same associated source (if the line has 
a single span then the article clearly teaches this, if the line has more than one span but there is 
only one line of the at least one lines in a slice then section 3. 1 second paragraph last line 
teaches a two spans having the same source since it teaches they maybe the same or 
different)] 

for each span in each line, reading data from the associated source without 
using a double image buffer (section 2. 1 last paragraph, section 3.0 last paragraph, 



dividing the image into one or more slices (assume one slice, then the 



dividing each line in each slice into at least one span (sections 3 and 3.1 
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section 4 paragraph 8, section 6.3 second paragraph, section 12.4 describes memory 
used in the MITV which uses buffers to buffer the sources but does not use a double 
image buffer)] 

identifying portions of the image that are opaque (section 3. 1 third 
paragraph lists the types of image data the Bruma chip can process, the pixel data or 
per span alpha data with alpha values indicating no translucence determines portions of 
the image which are opaque) and portions of the image that are translucent (section 3 
second paragraph and section 3. 1 paragraphs 3 and 4 describes alpha blending 
depending upon the alpha value, thus, pixel data with alpha values indicating 
translucence indicates portions that are translucent)] 

for each portion of the image that is translucent, reading, blending and 
displaying the data from the one or more sources corresponding to the translucent 
portion (pixel data with alpha values instructs the Burma chip that more than one source 
is present for this portion of the image)] 

for each portion of the image that is opaque, reading only from the one or 
more sources that corresponds to the opaque portion and that would be visible within 
the opaque portion during display of the image (page 2 lines 8-9 describes electronic 
program guide, figure 7-2 illustrates an EPG with the image of the video for a channel 
shown in the upper right of the screen shot is opaque and it is from one source and 
where the EPG characters are opaque and read from a different source), and without 
reading from any sources corresponding to data that would not be visible in the opaque 
portion during display of the image (images of the video from the past and the future are 
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not read from the source, only the current image is read, images of characters that are 
not displayed in the EPG are not read from the source of characters, etc, this negative 
limitation is very broad) (additionally due to the claim language of one or more slices, at 
least one line, at least one span, and at least one associated source the claim claims a 
single image from a single source having pixel data without alpha values such as a TV 
channel that is completely opaque which is clearly taught by this article). 

Claim 2: 

This article describes at page 12 first column lines 5-10 loading each associated source 
in memory. 

Claim 3: 

The lists are a control structure having context information. 
Claim 4: 

The lists inherently have the broadly claimed headers since an identifier for each image, 
each list, each line, and their source is necessary. 

Claim 5: 

Section 3.1 second paragraph describes lists of span each having a horizontal lines of 
pixels of varying length, therefore, contiguous pixel data for a line is read from the 
associated source. 
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Claim 6: 

Sections 3 and 3.1 describe blending which requires two or more sources of pixel data. 
If there were only a first source then there would be no other pixels to blend with the 
pixel's from the first source of pixels. 

Claim 9: 

The article at page 3 second column line 8 describes flickering as controlled on a span 
basis, thus, vertically adjacent spans are filtered to reduce flicker. 

Claim 10: 

This article teaches in a system including a display device for displaying; an image, 
each image being generated from one or more sources, each source having data, a 
method for compositing the image, the method comprising the acts of: 

generating a control structure having context information (the lists are a 
control structure having context information) describing the image, wherein the context 
information identifies the one or more sources (inherently the list identifies the source)] 

reading the data of the one or more sources according to the context 
information without storing a composite image of the data in a double image buffer 
(section 2. 1 last paragraph, section 3.0 last paragraph, section 4 paragraph 8, section 
6.3 second paragraph, section 12.4 describes memory used in the MITV which uses 
buffers to buffer the sources but does not use a double image buffer)] and 
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displaying the read data on the display device as the data is read from the 
one or more sources (as the data is read the Burma chip processes the video and 
sends it to video memory for display on the TV). 

Claim 11: 

Section 3.1 describes the list defining an image as having spans that can be of different 
lengths then this article teaches at last two images with each image having a slice 
having several lines with each line of the image being a span on the TV line and each 
span has a source. 

Claim 12: 

The lists inherently have the broadly claimed headers since an identifier for each 
image, each list, each line, and their source is necessary. 

Claim 13: 

This article describes at page 12 first column lines 5-10 loading each associated source 
in memory. 

Claim 14: 

Sections 3 and 3.1 describe blending which requires two or more sources of pixel data. 
If there were only a first source then there would be no other pixels to blend with the 
pixel's from the first source of pixels. 
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Claim 16: 

The article at page 3 second column line 8 describes flickering as controlled on a span 
basis, thus, vertically adjacent spans are filtered to reduce flicker. 



9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

10. Claims 17-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
the newly cited article titled The Microsoft Interactive TV System: An Experience Report 
by Michael B. Jones, July, 1997, Technical Report MSR-TR-97-18 and in view of 
Perlman et aL, U.S. Patent No. 5,745,909, already of record. 



This article teaches in a system including a display device for displaying an image, a 
method for reducing the flicker of a portion of the image (see section 3.1 paragraph 3 
line 9), the method comprising the acts of: 

reading data from a source, wherein the data is the portion of the image that is subject 
to flickering, and wherein the data defines a single span of a plurality of spans that are 
included in a line (see section 3 paragraph 2, see section 3. 1 paragraph 3 lines 9 and 



Claim Rejections - 35 USC § 103 



Claim 17: 



m 



reading previous data from the source, wherein the previous data 
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corresponds to a previous span in a previous line, wherein the previous span is 
vertically adjacent to the span (to reduce flicker in interlaced TV displays at least one of 
the previous and next lines are filtered with the current line) and comprises only one of a 
plurality of spans in the previous line (section 3. 1 paragraph 3 line 9 which describes 
flicker filtering on a span basis rather than flicker filtering all of the lines on the TV)] 
reading next data from the source, wherein the next data corresponds to a next span in 
a next line and wherein the next span is vertically adjacent to the span (to reduce flicker 
in interlaced TV displays at least one of the previous and next lines are filtered with the 
current line) and comprises only one of a plurality of spans in the next line (section 3.7 
paragraph 3 line 9 which describes flicker filtering on a span basis rather than flicker 
filtering all of the lines on the TV)\ and 

blending the previous span data, the span data subject to flickering, and the next span 
data , without blending the entire line, previous line and next line, (section 3.7 paragraph 
3 line 9 describes flicker filtering on a span basis rather than flicker filtering all of the 
lines on the TV) and such that the flicker that would otherwise exist at the portion of the 
image corresponding to the span is reduced (section 3 paragraph 2 lines 8-77). 

The article's description of the Burma chip did not indicate which type of flicker 
filter was used. 

Perlman teaches a flicker filter that filters the previous and next lines with the 
current line. 

It would have been obvious to one of ordinary skill in the at to use the flicker filter 
of Perlman in the Burma chip so a good flicker free image will be displayed. 
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Claim 18: 

Inherent to the article's system. 
Claim 19: 

Section 3.1 describes various formats for the pixels in the third paragraph. In the fourth 
paragraph a color space converter is described. 

The article does not appear to describe in what order the input pixels are blended and 
color space converted. 

It would have been obvious to one of ordinary skill in the art to blend for example two 
RGB format pixels prior to color space conversion to YcrCb color space because this 
will save processing time due to only having to perform color space conversion once 
after blending instead of color space conversion twice, once for each pixel stream, and 
then blending, thus, blending first is two processes and blending after is three 
processes the Burma chip would have to perform. 



Claim 20: 

The TV is interlaced and displays images using interlaced fields, the span included in 
the line is displayed on the TV. 
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11. Claims 21-25 and 27 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over the newly cited article titled The Microsoft Interactive TV System: An Experience 
Report by Michael B. Jones, July, 1997, Technical Report MSR-TR-97-18. 
As described in the 1 12 second paragraph rejection of claims 21-27, claim 21 in one 
instance of its alternative language claims one blending unit and converting its output to 
a single color space and blending its outputs into an image data stream since the output 
of the Burma chip is a stream of pixels, thus the output of the Burma chip is blended into 
an image data stream of many pixels. 

Section 3.1 describes various formats for the pixels in the third paragraph. In the fourth 
paragraph a color space converter is described. 

The article does not appear to describe in what order the input pixels are blended and 
color space converted. 

It would have been obvious to one of ordinary skill in the art to blend for example two 
RGB format pixels prior to color space conversion to YcrCb color space because this 
will save processing time due to only having to perform color space conversion once 
after blending instead of color space conversion twice, once for each pixel stream, and 
then blending, thus, blending first is two processes and blending after is three 
processes the Burma chip would have to perform. 



# # 
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Claim 22: 

See section 3.1 third paragraph. 
Claim 23: 

A double buffer is not used. Section 2.1 last paragraph, section 3.0 last paragraph, 
section 4 paragraph 8, section 6.3 second paragraph, section 12.4 describes memory 
used in the MITV which uses buffers to buffer the sources but does not use a double 
image buffer. 

Claim 24: 

Section 3.1 second paragraph describes the line having more than one span, thus, data 
streams for different spans on one line are offset in time and display space, thus, after 
the data stream is received its received place may not be the same as its displayed 
space and will need to be offset timewise and space wise. 

Claim 25: 

The centering the data streams around zero is a broad limitation and is met by 
decoding the data streams described in section 9.4 since the pixel data is encoded with 
additional information for transmission across the network and then decoded back to 
pixel data, thus, it must be put back to where it started or in other words the data 
streams will need to be centered to where they were prior to transmission, centered 
around. 
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Claim 27: 

When alpha blending is performed the pixels are multiplied by the alpha values that are 
present in the data stream. 



Claim 7: 

A prior art rejection cannot be made because the metes and bounds of this claim is not 
definite and because the specification does not support this claim. Thus, an indication 
of allowability would be premature. 
Claims 15 and 26: 

A prior art rejection cannot be made because the metes and bounds of these claims are 
not definite. Thus, an indication of allowability would be premature. 



12. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Jeffery A. Brier whose telephone number is (703) 
305-4723. The examiner can normally be reached on M-F from 6:30 to 3:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi, can be reached at (703) 305-4713). 
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Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 



Washington, D.C. 20231 



or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 




Jeffery A Brier 
Primary Examiner 
Art Unit 2672 



